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1 We applied the evidence-based concept to 12 case studies, 3 of them already mentioned in the 

2 main document. The details about the context, facet, the design as well as the critical appraisal 

3 (the quality assessment) are given in Table Si. We further present the quality checklist that was 

4 used to determine the study quality in all 12 case studies (Table S2). We covered a broad range 
s of case studies, providing an example for all facets (quantification, valuation, management and 
6 governance) and all different study designs. 
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Table S2: Quality checklist used to obtain the quality points (2b in Table Si) 









Bowler 


Lindhjem 
2007 


Ayanu 


Liu et 


Millar 


Acuna 


Lara 


Barkmann 
etal. 2008 


Xie 


Karimzadegan 
et al. 2007 


Entenmann 






Reference: 


etal. 


etal 


al. 


et al. 


et al. 


et al. 


etal. 


and Schmitt 








2010 


2012 


2008 


2010 


2013 


2009 


2011 


2013 




1 


Correspondence (Does the question match the 


yes 


yes 


yes 


yes 


yes 


yes 


yes 


yes 


yes 


yes 


yes 






answer?) 


























2 


Are the assumption used in the study reasonable? 


yes 


yes 


yes 


/ 


yes 


yes 


yes 


yes 


yes 


yes 


no 




3 


Internal validity: Do design and implementation 


yes 


yes 


no 


no 


yes 


yes 


no 


yes 


no 


no 


no 






avoid a high risk of bias? 




























External validity/relevance: Is the result 


yes 


no 


yes 


yes 


yes 


yes 


yes 


no 


yes 


yes 


yes 




4 


transferable to other scenarios with the same 
context? 


























5 


Are multiple lines of evidence considered? 


no 


no 


no 


no 


no 


no 


no 


/ 


no 


no 


no 




6 


Was the target population/area defined in space, 


yes 


yes 


no 


yes 


yes 


no 


yes 


no 


no 


yes 


yes 






time and size? 


























7 


Was a sampling population/area defined? (Which 


yes 


yes 


no 


no 


yes 


yes 


yes 


yes 


yes 


yes 


yes 






population/area was sampled?) 
























c 




Were potential differences between the target 


yes 


no 


/ 


/ 


no 


/ 


no 


/ 


/ 


no 


no 


o 


8 


population and the sampling population 
























u 

_QJ 




considered? 
























~o 

O 


9 


Were the methods described in sufficient detail to 


yes 


yes 


/ 


no 


yes 


yes 


yes 


no 


yes 


yes 


yes 


ru 




permit replication? 
























O 


10 


Was the sample size appropriate? 


yes 


yes 


yes 


no 


yes 


yes 


no 


yes 


no 


no 


yes 




11 


Was probability sampling used for constructing 


/ 


/ 


/ 


/ 


no 


no 


no 


no 


no 


no 


no 




the sample? 


























12 


If secondary data are used, did an evaluation of the yes 


yes 


yes 


no 


/ 


/ 


/ 


/ 


/ 


no 


/ 




original data take place? 


























13 


Is the choice of statistical/analytical method 


yes 


yes 


/ 


/ 


yes 


yes 


yes 


yes 


no 


/ 


yes 


(/i 

'•SI 


justified and comprehensively explained? 
























_>• 


14 


Are variables and statistical measures given? 


yes 


yes 


/ 


/ 


yes 


no 


yes 


yes 


yes 


no 


yes 


C 

< 


15 


Was accuracy/uncertainty assessed and 


yes 


yes 


/ 


no 


no 


yes 


no 


no 


no 


no 


no 




reported? 


























16 


Are results consistent and homogeneous? 


yes 


yes 


/ 


yes 


yes 


no 


yes 


yes 


yes 


yes 


yes 




17 


Magnitude of effect: Is the effect large (and 


no 


no 


/ 




yes 


no 


no 


/ 


no 


no 


no 


"5 

<5 


without large uncertainty) 
























a: 


18 


Attrition bias: Are non-response/drop-outs given 


yes 


/ 


no 


no 


/ 


/ 


/ 


no 


/ 


/ 


no 




and is their impact discussed 


























Design-dependent aspects: 




























Low probability of publication bias? E.g. results 


yes 


yes 


no 


no 


/ 


/ 


/ 


/ 


/ 




/ 




19 


reporting a negative relationship were probably 
not included 


























20 


Is the review based on high evidence individual 


yes 


no 


yes 


no 


/ 


/ 


/ 


/ 


/ 




/ 




studies (several level 2 or level 3 studies)? 


























21 


Validity - Do the studies included respond to the 


yes 


yes 


yes 


/ 


/ 


/ 


/ 


/ 


/ 




/ 


> 
cu 
cc 


same question? 


























22 


Was the literature searched in a systematic way? 


yes 


no 


yes 


no 


/ 




/ 








/ 




24 


Was a meta-analysis (in the strict sense: see 


yes 


yes 


no 


no 


















Borenstein et al. 2009) indcluded? 


yes 


yes 


no 


no 


















25 


Selection bias: Was the assignment of case- 


/ 


/ 


/ 


/ 


no 


no 


/ 




/ 




/ 


11 

CJ 


control groups randomized? 
























eferer 


26 


Were groups designed equally, aside from the 


/ 


/ 


/ 


/ 


no 


yes 


/ 


/ 


/ 




/ 


investigated point of interest? 




























Performance bias: Was the sampling blinded, e.g. 


/ 


/ 


/ 


/ 


no 


no 


/ 


/ 


/ 




/ 


1 


27 


researchers taking samples of a specific area 


























wouldn't know which differences are between 
























gj 




these areas? 
























Z3 


28 


Were there sufficient replicates of treatment and 


/ 


/ 


/ 


/ 


yes 


yes 


/ 


/ 


/ 




/ 




reference groups? 


























Category-dependent aspects: 


























29 


Were future values of ecosystem services 


/ 


yes 


/ 


/ 


/ 


/ 


/ 


no 


/ 


no 


/ 




considered? 


























30 


If future values were considered, were they 


/ 


yes 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


c 


discounted with a well-motivated discount rate? 
























o 




If aggregate economic values for a population were 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


no 


/ 


no 


/ 


D 


31 


estimated, was this estimation consistent with the 
























> 


sampling procedure and the definition of the 
population? 


























32 


If valuation took place in form of a questionnaire, 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


yes 


/ 


/ 


/ 



Desanker 
2005 



3Z 

was the study pre-tested and piloted? 



Quality points 24/26 20/27 10/18 5/20 14/25 14/24 10/19 10/20 8/18 8/21 10/20 



4 
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